language interface
SysCaps: Language Interfaces for Simulation Surrogates of Complex Systems
Emami, Patrick, Li, Zhaonan, Sinha, Saumya, Nguyen, Truc
Data-driven simulation surrogates help computational scientists study complex systems. They can also help inform impactful policy decisions. We introduce a learning framework for surrogate modeling where language is used to interface with the underlying system being simulated. We call a language description of a system a "system caption", or SysCap. To address the lack of datasets of paired natural language SysCaps and simulation runs, we use large language models (LLMs) to synthesize high-quality captions. Using our framework, we train multimodal text and timeseries regression models for two real-world simulators of complex energy systems. Our experiments demonstrate the feasibility of designing language interfaces for real-world surrogate models at comparable accuracy to standard baselines. We qualitatively and quantitatively show that SysCaps unlock text-prompt-style surrogate modeling and new generalization abilities beyond what was previously possible. We will release the generated SysCaps datasets and our code to support follow-on studies.
- North America > United States > Maryland > Baltimore (0.04)
- North America > Dominican Republic (0.04)
- North America > Canada > Newfoundland and Labrador > Labrador (0.04)
- Asia > China > Hong Kong (0.04)
- Energy > Renewable > Wind (0.70)
- Construction & Engineering > HVAC (0.69)
- Government > Regional Government > North America Government > United States Government (0.46)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
ValueNet: A Neural Text-to-SQL Architecture Incorporating Values
Brunner, Ursin, Stockinger, Kurt
Building natural language interfaces for databases has been a long-standing challenge for several decades. The major advantage of these so-called text-to-SQL systems is that end-users can query complex databases without the need to know SQL or the underlying database schema. Due to significant advancements in machine learning, the recent focus of research has been on neural networks to tackle this challenge on complex datasets like Spider. Several recent text-to-SQL systems achieve promising results on this dataset. However, none of them extracts and incorporates values from the user questions for generating SQL statements. Thus, the practical use of these systems in a real-world scenario has not been sufficiently demonstrated yet. In this paper we propose ValueNet light and ValueNet -- the first end-to-end text-to-SQL system incorporating values on the challenging Spider dataset. The main idea of our approach is to use not only metadata information about the underlying database but also information on the base data as input for our neural network architecture. In particular, we propose a novel architecture sketch to extract values from a user question and come up with possible value candidates which are not explicitly mentioned in the question. We then use a neural model based on an encoder-decoder architecture to synthesize the SQL query. Finally, we evaluate our model on the Spider challenge using the Execution Accuracy metric, a more difficult metric than used by most participants of the challenge. Our experimental evaluation demonstrates that ValueNet light and ValueNet reach state-of-the-art results of 64% and 60% accuracy, respectively, for translating from text to SQL, even when applying this more difficult metric than used by previous work.
- Europe > France (0.05)
- Europe > Switzerland > Zürich > Zürich (0.04)
- North America > United States > New York > New York County > New York City (0.04)
- (6 more...)
Natural language interface for data visualization debuts at prestigious IEEE conference
BROOKLYN, New York, Tuesday, October 22, 2019 – The ubiquity and sheer volume of data generated today give experts in virtually every domain ample information to track everything from financial trends, disaster evacuation routes, and street traffic, to animal migrations, weather patterns, and disease vectors. But using this data to build visualizations of complex predictive models using machine learning is a challenge to experts who lack the requisite computer science skills. A team at the NYU Tandon School of Engineering's Visualization and Data Analytics (VIDA) lab, led by Claudio Silva, professor in the department of computer science and engineering, developed a framework called VisFlow, by which those who may not be experts in machine learning can create highly flexible data visualizations from almost any data. Furthermore, the team made it easier and more intuitive to edit these models by developing an extension of VisFlow called FlowSense, which allows users to synthesize data exploration pipelines through a natural language interface. The research, "FlowSense: A Natural Language Interface for Visual Data Exploration with a Dataflow System" won the best-paper award at this year's IEEE Conference on Visual Analytics Science and Technology (VAST).
- North America > United States > New York > Kings County > New York City (0.25)
- North America > Canada > British Columbia > Metro Vancouver Regional District > Vancouver (0.05)
- Asia > Middle East > UAE > Abu Dhabi Emirate > Abu Dhabi (0.05)
- Asia > China > Shanghai > Shanghai (0.05)
What's Microsoft's vision for conversational AI? Computers that understand you - The AI Blog
Today's intelligent assistants are full of skills. They can check the weather, traffic and sports scores. They can play music, translate words and send text messages. They can even do math, tell jokes and read stories. But, when it comes to conversations that lead somewhere grander, the wheels fall off.
role of artificial intelligence in robot – Munmun Agarwal – Medium
Robots and artificial intelligence (AI) will soon be coming to a workplace near you, and people have mixed feelings about it.As the workplace becomes more high-tech, it makes sense to look at how the increasing use of robotics and AI will impact different professions. The first industry to see robotic innovation was manufacturing, and the use of robots has only evolved over time. Increased intelligence -- Robots were originally only suited for unskilled tasks. New robots can now understand and learn from images, videos, and audio. Some robots even have a rudimentary ability to reason.
5 Best Frameworks For Machine Learning
In this article, let's check about some of the best frameworks and libraries for Machine Learning. This list is created by me based on a variety of parameters, some would surely not accept it but again it is according to me and would vary from person to person. If you are a beginner, check out our articles on "Machine learning crash course" and "Machine learning specialization course". Each of these Frameworks is different from each other and takes much time to learn, during the time of making this list we took care of features other than the basic ones, User base and community & support was one of the most important parameters. Some frameworks are more mathematically oriented, and hence geared more towards statistical than neural networks. Some of them provide a rich set of linear algebra tools; some are mainly focused only on deep learning.
Microsoft acquires AI company to make Cortana and bots sound more human
Microsoft is acquiring conversational AI startup Semantic Machines in an effort to make bots and intelligent assistants like Cortana sound and respond more like humans. Founded in 2014, Semantic Machines uses machine learning to make bots respond in a more natural way to queries. Semantic Machines is led by UC Berkeley professor Dan Klein and former Apple chief speech scientist Larry Gillick. Both are considered pioneers in conversational AI. Microsoft's acquisition will boost the company's Cortana digital assistant, as well as the company's Azure Bot Service that's used by 300,000 developers.
Making Artificial Intelligence Easy to Understand
We are slowly becoming used to the idea of artificial intelligence being a part of our everyday lives. Home automation systems and home integration are becoming more popular and people are becoming more comfortable interacting with these systems. The idea that artificial intelligence is going to be an ever present part of our future reality is not only not far-fetched, is is pretty much set in stone. So, what is artificial intelligence really? The simple way to put artificial intelligence into perspective is to understand and input output system.
Robotic automation takes off in the Nordics
Automation is among the top priorities for Nordic IT decision makers in 2017, according to the latest TechTarget survey, with 37% of Nordic-based survey respondents planning to implement an IT automation initiative during the year. This email address is already registered. By submitting my Email address I confirm that I have read and accepted the Terms of Use and Declaration of Consent. By submitting your personal information, you agree that TechTarget and its partners may contact you regarding relevant content, products and special offers. You also agree that your personal information may be transferred and processed in the United States, and that you have read and agree to the Terms of Use and the Privacy Policy. Robotic process automation (RPA) is a particularly hot topic, but what does it mean for Nordic companies?
- North America > United States (0.25)
- Europe > Finland (0.16)
- Europe > United Kingdom (0.05)
- Europe > Sweden (0.05)